Apparatus, system, and method of use of imaging assembly on mobile terminal

ABSTRACT

A system for collecting data comprising a mobile terminal for capturing a plurality of frames of image data, the mobile terminal having a first imaging assembly and a second imaging assembly, the first imaging assembly for capturing a first frame of image data representing a first object and the second imaging assembly for capturing a second frame of image data representing a second object, wherein the system for use in collecting data is operative for associating first frame information and second frame information, the first frame information including one or more of image data of the first frame of image data and information derived utilizing the image data of the first frame of image data, the second frame information including one or more of image data of the second frame of image data and information derived utilizing the image data of the second frame of image data.

FIELD OF THE INVENTION

The present invention relates generally to a data collection system,and, more specifically, to imaging devices on a mobile terminal.

BACKGROUND OF THE PRIOR ART

A mobile terminal is used for sending and receiving information in acommunication system, such as a mobile telephone in a cellular telephonesystem. A mobile terminal can communicate with one or more externalserver. The one or more external server can include one or more localserver and one or more remote server.

A mobile terminal can include a display and input devices, such askeypads, buttons, and the like, which are used to control the mobileterminal. The display is used for viewing information and the inputmechanisms typically provide for data entry, as well as control of anymulti-media interface including the display. In some mobile terminals adisplay is provided with an associated touch panel to form a touchscreen display. A mobile terminal having a display can display virtualinput actuators, often referred to as virtual buttons. A mobile terminalcan also include an imaging device for taking an image. One example of amobile terminal is a mobile terminal which is equipped with one or moreradio transceivers for providing communication with a cellular network.Another example of a mobile terminal is known as the a portable dataterminal which can be primarily used in data collection applicationincluding shipping and warehouse applications, as well as retail storeapplications and health care facility data management applications.

Mobile terminals are also available in a form devoid of a display. Forexample a gun style bar code reader is commonly provided in a formdevoid of a display. Gun style bar code readers are commonly used inretail stores, and shipping warehouses.

SUMMARY OF THE INVENTION

A system for collecting data including a mobile terminal for capturing aplurality of frames of image data, the mobile terminal having a firstimaging assembly, a second imaging assembly, a display, and a hand heldhousing on which the display is disposed and which houses one or morecomponents of the first imaging assembly and one or more components ofthe second imaging assembly, wherein the first imaging assembly includesa first image sensor array and a first imaging lens focusing an imageonto the first image sensor array of the first imaging assembly, thefirst image sensor array having a plurality of pixels, the first imagingassembly for use in capturing a first frame of image data representing afirst image, wherein the second imaging assembly comprises a secondimage sensor array and a second imaging lens focusing an image onto thesecond image sensor array of the second imaging assembly, the secondimage sensor array having a plurality of pixels, the second imagingassembly for use in capturing a second frame of image data representinga second object. Furthermore, the system for use in collecting data canbe operative for associating first frame information and second frameinformation, the first frame information including one or more of imagedata of the first frame of image data and information derived utilizingthe image data of the first frame of image data, the second frameinformation including one or more of image data of the second frame ofimage data and information derived utilizing the image data of thesecond frame of image data.

This Summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This Summary is not intended to identify key features oressential features of the claimed subject matter, nor is it intended tobe used as an aid in determining the scope of the claimed subjectmatter. The claimed subject matter is not limited to implementationsthat solve any or all disadvantages noted in the background.

BRIEF DESCRIPTION OF THE DRAWINGS

The features described herein can be better understood with reference tothe drawings described below. The drawings are not necessarily to scale,emphasis instead generally being placed upon illustrating the principlesof the invention. In the drawings, like numerals are used to indicatelike parts throughout the various views.

FIG. 1 is a system diagram illustrating a system for collecting dataaccording to some embodiments of the present invention;

FIG. 2 is a diagram of a mobile terminal according to some embodimentsof the present invention;

FIG. 3 is a diagram of a mobile terminal according to some embodimentsof the present invention;

FIG. 4 is a diagram of a mobile terminal according to some embodimentsof the present invention;

FIG. 5 is a block diagram illustrating a mobile terminal according tosome embodiments of the present invention;

FIG. 6 a method of operation in accordance according to some embodimentsof the present invention;

FIG. 7 is a timing diagram illustrating operation of a data collectionsystem in some embodiments;

FIG. 8 is a schematic diagram illustrating a use application of thesystem set further herein;

FIG. 9 is a set of diagrams illustrating an associating of frameinformation in one embodiment;

FIG. 10 is a set of diagrams illustrating an associating of frameinformation in one embodiment.

DETAILED DESCRIPTION OF THE INVENTION

FIG. 1 is a system diagram illustrating a system 800 for collecting dataaccording to some embodiments of the present invention. A mobileterminal 10 can be connected to a server 500 via communication link 700.The server 500 can be located in a local environment (e.g., the samebuilding, etc.) relative to the mobile terminal 10, or a remoteenvironment. Data can be exchanged between the mobile terminal 10 andserver 500 over the communication link 700. System 800 can be in networkcommunication with one another via appropriate communication protocols,e.g., TCP/IP communication protocols, UDP/IP communication protocols, orother suitable network communication protocols. In some embodiments,terminal 10 and server 500 can be disposed in a common local facility.In some embodiments, terminal 10 can be disposed in a common localfacility and server 500 can be disposed remote from the local facility.In some embodiments, terminal 10 can be transported between a pluralityof local destinations as in a shipping application, and server 500 canbe disposed remote from each of the local destinations. In someembodiments, where recited functionality is performed by terminal 10without use of server 500, system 800 can be regarded as includingterminal 10 without including server 500.

FIG. 2 is a diagram of a mobile terminal 10 according to someembodiments of the present invention. Mobile terminal 10 includes afirst imaging window 162 and second imaging window 262. The mobileterminal includes a hand held housing 300 on which a display 52 isdisposed. Display 52 can extend in a display plane 190, hand heldhousing 300 also houses and has disposed therein one or more componentsof the first imaging assembly 150 and the second imaging assembly 250.

The first imaging assembly 150 can be positioned behind the firstimaging window 162 such that the first imaging assembly 150 can beutilized for capture of a frame of image data representing an object.The first imaging assembly 150 can have a first imaging axis 160. Thefirst imaging assembly 150 ideally can be utilized for capture of aframe of image data representing an object, where the object is locatedalong first imaging axis 160, or within a field view of first imagingassembly 150 centered around first imaging axis 160.

Similarly, the second imaging assembly 250 can be located behind thesecond imaging window 262 and can have a second imaging axis 260. Thesecond imaging assembly 250 can be utilized for capture of a frame ofimage data representing an object, where the object is located alongsecond imaging axis 260 or within a field view centered around secondimaging axis 260.

The first imaging window 162 can be located on a first side 170 of themobile terminal 10, and the second imaging window 262 can be located ona second side 168 of the mobile terminal 10 that is opposite first side170. Accordingly, the first imaging window 162 and second imaging window262 are oriented on opposite sides 168, 170 and face oppositedirections. First imaging assembly 150 in the embodiment of FIG. 2 has afirst imaging axis 160 extending upwardly from terminal 10 and secondimaging assembly 250 has a second imaging axis 260 extending downwardlyfrom terminal 10. Directions of imaging axes 160, 260 set forth hereinare directions extending from an image sensing source, e.g., as imagesensor array to a target defined by a field of view of the imagingassembly associated to an image sensing source.

In a further aspect of the embodiment of FIG. 2, the display 52 extendsin a display plane 190 as illustrated. The first imaging axis 160extends from the mobile terminal 10 upwardly from the display plane 190while the second imaging axis 260 extends from the mobile terminal 10downwardly from the display plane 190. Accordingly, a user may operatethe mobile terminal 10 to capture a first frame representing a firstobject located on a first side of the display plane 190, and to capturea second frame representing a second object that is located on anopposite side of the display plane 190. In some embodiments, the firstimaging axis 160 and second imaging axis 260 are orthogonal to displayplane 190. In some embodiments, the first imaging axis 160 and secondimaging axis 260 form a collinear path with first imaging axis 160 offirst imaging assembly 150 extending upwardly from terminal 10 andsecond imaging axis 260 of second imaging assembly 250 extendingdownwardly from terminal 10. While imaging axis 260 is depicted asextending downwardly from terminal 10 in the embodiment of FIG. 2,terminal 10 can also be configured so that imaging axis 260 extendsforwardly from terminal 10 as is depicted by imaging axis 260 shown withrelatively longer dashes. “Forwardly” herein is inclusive of directionsthat are upwardly forwardly or downwardly forwardly. Similarly“upwardly” is inclusive of directions that are rearwardly upwardly orforwardly upwardly, “downwardly” is inclusive of directions that arerearwardly downwardly or forwardly downwardly, and “rearwardly” isinclusive of directions that are upwardly rearwardly or downwardlyrearwardly.

In another aspect, system 800 can be operative to associate first frameinformation and second frame information. The first frame informationcan be image data of the first frame or data derived utilizing the firstframe of image data. The second frame information can be image data ofthe second frame of data or data derived utilizing the second frame ofimage data. In some embodiments, associating includes providing a filethat includes information relating to both frames i.e., first frameinformation and second frame information. In some embodiments, themobile terminal 10 is configured to associate first frame informationand second frame information. In such embodiments, mobile terminal 10can be configured to process one or more of the first and second framesprior to performing association. In some embodiments, the mobileterminal 10 transmits the first frame and the second frame to server 500via communication link 700, and server 500 is configured to theassociate of the first frame information and the second frameinformation. Prior to associating, system 800 can process one or more ofthe first frame and the second frame. Such processing can be performedby one or more of terminal 10 and server 500.

As illustrated in FIG. 2, the first imaging axis 160 and second imagingaxis 260 can be parallel and spaced apart from each other. By having thefirst imaging axis 160 and second imaging axis 260 parallel anddisplaced from each other and extending in opposite directions fromtheir associated image sensor array, a user can easily aim the firstimaging axis 160 and second imaging axis 260 to accurately capture firstand second frames respectively first and second objects where theobjects are located on opposite sides of a display plane. In someembodiments, one or more of the first imaging assembly 150 and secondimaging assembly 250 includes an image sensor array provided by aninfrared camera that can be used when the ambient lighting is at asufficiently low level.

FIG. 3 is a diagram of a mobile terminal 10 according to anotherembodiment. In some embodiments, the first imaging axis 160 and secondimaging axis 260 extend in directions that are non-parallel relative toone another so that the first imaging assembly 150 can have a field ofview centered about axis 160 encompassing a first object that isoriented at a first angle relative to the display plane 190, while thesecond imaging assembly 250 can have a field of view centered about axis260 encompassing a second object that is oriented at a second anglerelative to the display plane 190 that is different from the firstangle. In some embodiments, by having the first imaging axis 160 andsecond imaging axis 260 extend in directions that are non-parallelrelative to one another, a user may utilize terminal 10 for capture of afirst frame of image data representing a first object within a field ofview of first imaging assembly 150, and a second frame of image datarepresenting a second object within a field of view of second imagingassembly 250.

FIG. 4 is a diagram of a mobile terminal 10 according to anotherembodiment. The first imaging window 162 is located on a side 200 of themobile terminal 10 that is substantially orthogonal to the display plane190. Accordingly, the first imaging axis 160 is substantially parallelto the display plane 190, while the second imaging axis 260 is notparallel to the display plane 190. The first imaging axis 160 and secondimaging axis 260 also extend in directions that are non-parallelrelative to one another. While imaging axis 160 of FIG. 4 is depicted asextending rearwardly from terminal 10, terminal 10 otherwise configuredas shown in FIG. 4 can be configured so that imaging axis 160 extendsforwardly from terminal 10.

While the first imaging axis 160 and second imaging axis 260 have beenillustrated as extending in specific directions, angles and alignmentsabove, the first imaging axis 160 and second imaging axis 260 can bealigned in any direction suitable for capturing a frame of a first imageand a frame of a second image with use of the respective imagingassemblies 150, 250. In the embodiment of FIGS. 2-4, imaging assemblies150, 250 can be fixedly disposed in housing 300 so that imaging axes160, 260 fixedly extend in a fixed direction from terminal 10. Inanother embodiment, terminal 10 can be configured so that an angle atwhich one or more of imaging axis 160 or imaging axis 260 extends fromterminal 10 can be changed, e.g., by manual adjustment initiated by anoperator.

FIG. 5 is a block diagram illustrating a mobile terminal 10 according tosome embodiments of the present invention. Mobile terminal 10 caninclude a power supply 44, memory 40, communication I/O interface 46,central processing unit (CPU) 38, a first imaging assembly 150 and asecond imaging assembly 250 communicatively coupled together via systembus 48. As illustrated, first imaging assembly 150 can be positionedbehind first imaging window 162, and second imaging assembly 250 can bepositioned behind second imaging window 262. Terminal 10 can also have atrigger 49 for initiating frame capture and display 52. Display 52 canhave an associated touch panel so that display 52 operates as a touchscreen. In another aspect, terminal 10 can include real time clock (RTC)47 coupled to system bus 48. Elements shown as being coupled to systembus 48 can be in communication with CPU 38. Dashed border 300 of FIG. 5indicates components that can be disposed within hand held housing 300in some embodiments. In another aspect, mobile terminal 10 can includeappropriate telephony hardware and software for enabling telephoniccommunication between terminal 10 and server 500 which in one embodimentcan be provided by a mobile terminal configured as a cellular mobiletelephone.

First imaging assembly 150 can include an image sensor array 152 thatcan be a CMOS image sensor having an M×N array of pixels 154, having aplurality of rows and columns of pixels. In some embodiments, the CPU 38can be operative to communicate with memory 40 and store data in memory40. First imaging assembly 150 can be operative to capture frames ofimage data by readout, conversion, and storage of frame of image datainto memory 40. Prior to readout of a frame, a frame can be exposedduring an exposure period of first imaging assembly 150. In someembodiments, the CPU 38 may be further operative to communicate with,and transmit information, to the communication I/O interface 46. Imagesensor array 152, in some embodiments can be an infrared image sensorthat is selectively sensitive to light in the infrared wavelength band.

Referring to further aspects of first imaging assembly 150, an imaginglens assembly 158 can be adapted for focusing an image onto image sensorarray 152. Lens assembly 158 and image sensor array 152 define a fieldof view of imaging assembly 150, as well as first imaging axis 160.Imaging light rays can be transmitted about first imaging axis 160.Imaging lens assembly 158 can be adapted to be capable of multiple focallengths and multiple best focus distances. Imaging lens assembly 158 mayinclude a focusing apparatus (e.g., a lens element, a fluid lens elementor a pump in combination with a lens element, etc.) employed alone or incombination with other optical elements (e.g., a deformable fluid lenselement, an electrowetting fluid lens element, or a traditionalnon-deformable solid (e.g., glass, polycarbonate lens element).

With an image focused, the image sensor array 152 may be utilized forcapture a frame of image data representing an object in the field ofview of imaging assembly 150.

Referring to further aspects of second imaging assembly 250, an imaginglens assembly 258 can be adapted for focusing an image onto image sensorarray 252. Lens assembly 258 and image sensor array 252 define a fieldof view of imaging assembly 250, as well as second imaging axis 260.Imaging light rays can be transmitted about second imaging axis 260.Imaging lens assembly 258 can be adapted to be capable of multiple focallengths and multiple best focus distances. Imaging lens assembly 258 mayinclude a focusing apparatus (e.g., a lens element, a fluid lens elementor a pump in combination with a lens element, etc.) employed alone or incombination with other optical elements (e.g., a deformable fluid lenselement, an electrowetting fluid lens element, or a traditionalnon-deformable solid (e.g., glass, polycarbonate lens element). In someembodiments, image sensor array 252 can be provided by an infrared imagesensor array that is selectively sensitive to light in the infraredwavelength band. In some embodiments, imaging assembly 150 can beoptimized for use in capture of frames visual display and imagingassembly 250 can be optimized for use in capture of frames forsubjecting to decoding for determining a decoded message encoded in adecodable indicia. For example, image sensor array 252 can be a colorimage sensor array having a color filter, e.g., a Bayer pattern and canbe devoid of monochrome pixels and image sensor array 152 can includemonochrome pixels devoid of color filters. For subjecting to decoding aframe of image data captured utilizing a color image sensor array, imagedata of one color set, e.g., red, green, or blue, can be subject toprocessing for decoding with missing pixels positions of the color setbeing populated with interpolated pixel values.

In some embodiments, the first imaging assembly 150 and/or secondimaging assembly 250 may be utilized for capture of a frame of imagedata representing a barcode. For attempting to decode a bar code symbol,e.g., a one dimensional bar code symbol, a CPU of mobile terminal 10(e.g., CPU 38 of mobile terminal 10) can process image data of a framecorresponding to a line of pixel positions (e.g., a row, a column, or adiagonal set of pixel positions) to determine a spatial pattern of darkand light cells and can convert each light and dark cell patterndetermined into a character or character string via table lookup. Wherea decodable indicia representation is a 2D bar code symbology, a decodeattempt can comprise the steps of locating a finder pattern using afeature detection algorithm, locating matrix lines intersecting thefinder pattern according to a predetermined relationship with the finderpattern, determining a pattern of dark and light cells along the matrixlines, and converting each light pattern into a character or characterstring via table lookup. In some embodiments, mobile terminal 10 can beoperative to capture a frame of image data and process the frame forattempting to decode the frame in response to an input, such as anactuation of a trigger. In some embodiments, the server 500 may decode abarcode instead of mobile terminal 10 e.g., responsively to terminal 10transmitting a frame of image data representing a barcode to server 500.

In some embodiments, server 500 can have the components of terminal 10,including CPU 38 and memory 40. In some embodiments, server 500 can bedevoid of imaging assemblies 150, 250. In some embodiments, server 500can be a peer device of terminal 10, and can have all or essentially allof the elements of terminal 10. FIG. 5 is labeled onto the referencenumeral 500 as well as numeral 10 to indicate that the components ofterminal 10 can be included in server 500.

FIG. 6 illustrates a method of operation 600 in accordance with someembodiments. At block 602 a mobile terminal 10 is provided that includesa first imaging assembly 150 and a second imaging assembly 250.

At block 604, the first imaging assembly 150 can be used to capture afirst frame of image data representing a first object. At block 606 thesecond imaging assembly 250 can be used to capture a second frame ofimage data representing a second object. In some embodiments, blocks 604and 606 occur contemporaneously such that the first frame of image datarepresenting a first object and the second frame of image datarepresenting a second object are contemporaneously captured.

In one example of a contemporaneous capture a first frame and a secondframe can be captured responsively to a common trigger event, as may beinitiated by an actuation of a trigger 49. As shown in FIG. 5, terminal10 can have a trigger 49 for use in activating a trigger signal.Terminal 10 can be configured so that an operator can activate a triggersignal by actuating a trigger, e.g., trigger 49. Trigger 49 can beprovided by a physical button (not shown) disposed on housing 300 or canbe a virtual trigger that is displayed on display 52. A timing diagramillustrating operation of terminal 10 in some embodiments is shown inFIG. 7. Trigger signal 702 can be made active by manually actuatingtrigger 49 which can be e.g., a physical trigger or a virtual triggerdisplayed on display 52. Responsively to the trigger actuating, whichcan make active trigger signal 702, first image sensor array 152 can beexposed at the logic high period of signal 704, and subject to readoutat the logic high period of signal 708, and during processing period 712CPU 38 can be processing a first frame captured having an exposure beingthe logic high period of signal 704 and a readout period being the logichigh period of signal 708.

Also responsively to actuation of trigger 49, second image sensor array252 can be exposed during a logic high period of exposure control signal716 for controlling exposure periods of second image sensor array 252.The second frame exposed during logic high period of signal 716 can beread out during a logic high period of signal 720, and a second framecaptured by readout, conversion and storage into memory 40 can beprocessed by CPU 38 at processing period 724.

It is seen with reference to the timing diagram of FIG. 7, thatexposure, read out and processing periods of the first frame capturedwith use of imaging assembly 150 and a contemporaneously captured secondframe captured with use of imaging assembly 250 can be simultaneous.However, such periods can be contemporaneous without being simultaneous,i.e., sequential in time or concurrent, e.g., by way of CPU 38 executingsteps associated with processing period 712 and processing period 724 ona time sharing basis. Also, the first frame captured utilizing firstimaging assembly 150 processed during processing period 712 and thesecond frame captured utilizing second imaging assembly 250 processedduring processing period 724 can each respectively be one frame of asuccession of frames that is captured utilizing its associated imagingassembly responsively to a trigger signal activation.

While terminal 10 can be operative in a mode of operation in which afirst frame and a second frame are captured responsively to an actuationof a trigger, and system 800 can be configured so that such a mode isoperator selectable and is made available with other operator selectablemodes of operation which when active such functionality is not present.There is set forth herein a system 800 operative in a first userselectable mode of operation and a second user selectable mode ofoperation, wherein the system is operative so that with the first userselectable mode of operation active, the mobile terminal 10 responsivelyto an activation of a trigger signal captures a frame of image datautilizing the first imaging assembly without a frame of image data beingcaptured utilizing the second imaging assembly, wherein the system isfurther operative so that with the second user selectable mode ofoperation active, the mobile terminal responsively to an activation of atrigger signal captures a first frame of image data utilizing the firstimaging assembly and a second frame of image data is captured utilizingthe second imaging assembly, wherein the system is further operative forassociating first frame information and second frame information, thefirst frame information including one or more of image data of the firstframe of image data and information derived utilizing the image data ofthe first frame of image data, the second frame information includingone or more of image data of the second frame of image data andinformation derived utilizing the image data of the second frame ofimage data. For enabling selection of the first and second modes, modeselection virtual buttons can be displayed on display 52. For enablingactuation of a trigger signal, one or more virtual triggers can bedisplayed on display 52. Terminal 10 can be operative so that first andsecond triggers are provided, so that actuation of the first triggeractivates the first mode and activates a trigger signal. Terminal 10 canbe further operative so that actuation of the second trigger activatesthe second mode and activates a trigger signal.

At block 608, first frame information and second frame information canbe associated by system 800. Like the capture of the first and secondframes of image data, the associating by system 800 and in someembodiments processing prior to associating can be responsive to theactuation of trigger 49 for activation of trigger signal 702. In someembodiments, the first frame information can include image data of thefirst frame of image data. In some embodiments, the first frameinformation can include information derived utilizing the image data ofthe first frame of image data. Such information derived utilizing theimage data of the first frame can be a decoded message decoded from abarcode symbol representation represented in the first frame. Similarly,in some embodiments, the second frame information can include image dataof the second frame of image data. Furthermore, in some embodiments, thesecond frame information can include information derived utilizing theimage data of the second frame of image data. Such information derivedutilizing image data of the second frame can be a decoded messagedecoded from a barcode symbol represented with second frame. It will beunderstood that prior to associating frame information corresponding toa frame, the frame can be subject to processing e.g., for decoding of abarcode symbol to determine a decoded message, formatting of the frameinto an image file format, or parsing image data for providing aprocessed frame.

As set forth herein, the system 800 for collecting data can operate toassociate the first frame information and second frame information. Theassociation can be performed by a CPU 38 of mobile terminal 10 or a CPU38 of server 500, or the associating can comprise steps distributed forperformance between the mobile terminal 10 and the server 500. In someembodiments, associating comprises providing a file that includes thefirst frame information and the second frame information. In someembodiments, associating comprises providing a file that includes areference to the first frame information and a reference to the secondframe information. In some embodiments, associating comprises providinga file that includes the first frame information and a reference to thesecond frame information. In some embodiments, a file for use inassociating can be in a markup language file format, Extensible MarkupLanguage (XML) format that includes a reference to one or more of thefirst frame information and the second frame information.

In some embodiments, system 800 can associate frame information of aplurality of frames of image data wherein frame information of eachframe includes image data. For associating image data of a plurality offrames, the plurality of frames of image data can be associated, e.g.,by referencing of the frames in a common file after formatting of theframes in an image file format, e.g., TIF, PDF, BMP, withoutmodification of image data of each of the frames. In another embodiment,image data of a plurality of frames captured utilizing different imagingassemblies can be associated by providing a processed frame having firstimage data pixel position coordinates comprising image data capturedutilizing a certain one of the imaging assemblies and second pixelposition coordinates comprising image data captured utilizing the otherone of the imaging assemblies.

System 800 can be operative to associate frame information of aplurality of frames captured utilizing different imaging assemblies byassociating image data of one of the frames with decoded barcode messagedata determined by processing the other of the frames. Associatingdecoded message data with image data can comprise, e.g., including thedecoded message data in an open data field location of an image fileincluding the image data or e.g., providing a file, e.g., text based,e.g., XML file having a reference to an image file and including thedecoded message. Image file formats, e.g., TIF, PDF, BMP, can have imagedata field locations for inclusion of image data, and open data fieldlocations in which variable data can be included. Frame information canbe included in such open field locations for association of frameinformation of first and second frames.

In another example of associating, associating performed by system 800at block 608 can include commonly displaying first frame information andsecond frame information on a common display e.g., display 52 ofterminal 10 and/or display 52 of server 500. Commonly displaying cancomprise sequentially displaying or simultaneous displaying of frameinformation. Where associated frame information of first and secondframes includes image data, commonly displaying on a display 52 (e.g. ofmobile terminal 10 or server 500) image data of a first frame and imagedata of a second frame can comprise display of a single image file,e.g., in the case a processed frame is provided having image data offirst and second frame, a plurality of image files, or zero image files,e.g., in the case raw image data is displayed without prior formattinginto an image file format.

In another aspect of method 600, which can be performed in combinationwith any example set forth herein, frames captured at block 604 andblock 606 can further be time stamped utilizing real time clock (RTC)47. A time stamp associated to a captured frame can be associated todata derived utilizing the captured frame. System 800 can utilize timestamping for associating frame information. In one example, system 800can perform associating at block 608 by identifying frame informationhaving a common time stamp. Such associating by identifying common timestamps can be performed e.g., by CPU 38 of terminal 10 or CPU 38 ofserver 500.

FIG. 8 illustrates a diagram 900 of an operator and mobile terminal 10according to some embodiments set forth herein. In FIG. 8, an operator920 is utilizing a mobile terminal 10. The first imaging axis 160 and afield of view 940 centered around first imaging axis 160 extendoutwardly and away from the mobile terminal 10. The face 950 of theoperator is within the field of view 940 and along the first imagingaxis 160. Accordingly, since the face 950 of the operator 920 is withinthe field of view 940, the operator 920 may use the first imagingassembly 150 (see FIG. 5) of mobile terminal 10 to capture a frame ofimage data representing face 950.

FIG. 8 further illustrates the second imaging axis 260 and a field ofview 930 centered around second imaging axis 260 that extends outwardlyand away from the mobile terminal 10. An object 910 is within the fieldof view 930 and along second imaging axis 260. Accordingly, since theobject 910 is within the field of view 930, the operator 920 may use thesecond imaging assembly 250 (see FIG. 5) of mobile terminal 10 tocapture a frame of image data representing an object. Thus, an operator920 may utilize terminal 10 to capture a frame of image datarepresenting their face 950 and a frame of image data representing anobject 910.

In some embodiments, the first frame of image data includes arepresentation of a first object and the second frame of image dataincludes a representation of a second object. These objects may besimultaneously present in a target environment. In some embodiments theassociation between frame information corresponding to the two objectsmay serve as a verification that the two objects were simultaneouslypresent. In some embodiments, a contemporaneous capturing of frames ofimage data representing the first object and second object occurs.

In some embodiments, the first frame of image data includes arepresentation of a health care provider (e.g., doctor) and the secondframe of image data a patient. Accordingly, by using the above describedmethods, structures and apparatus, an association can be created betweenframe information corresponding to a health care provider and frameinformation corresponding to the patient. The association createdbetween frame information corresponding to the health care provider andframe information corresponding to the patient may serve as a record orlog to determine whether a health care provider met with a patient.

In some embodiments, terminal 10 can be operated and system 800 can beconfigured so that the first frame of image data represents a providerof medicine and the second frame of image data represents an article(e.g., container) comprising medicine. The article can be labeled with abarcode. The second frame of image data can be subject to decoding todetermine a decoded message. The decoded message may indicatecharacteristics of the medicine (e.g., type, quantity, dosage, strength,etc.) For associating first frame information with second frameinformation, system 800 can associate image data of the first frame(representing a medicine provider) with a decoded message decoded byprocessing the second frame. Accordingly, by using the above describedmethods, structures and apparatus, an association can be created betweenthe provider of medicine, a person who received the medicine and themedicine.

In some embodiments, terminal 10 can be operated so that the first frameof image data represents an object to be delivered to a location, andthe second frame of image data represents the location. An associationbetween the image data representing the object to be delivered to alocation, and image data representing a scene indicating the locationcan serve as verification that the object was delivered. For instance, adelivery person could utilize terminal 10 to capture frames of imagedata representing the object and location as proof of delivery.Accordingly, by using the above described methods, structures andapparatus, an association can be created between the object to bedelivered to a location and the location.

In some embodiments, terminal 10 can be operated so that the first frameof image data represents a security officer and the second frame ofimage data represents a barcode that encodes a message that identifies alocation the security officer is assigned to patrol. In suchembodiments, system 800 can be operative to process the second frame todetermine the decoded message, and can further be operative to associateimage data of the first frame and the decoded message so that the firstframe information comprises image data of the first frame and the secondframe information comprises the decoded message. The association betweenthe first frame information comprising image data representing thesecurity officer and the second frame information comprising a decodedmessage identifying a location the security officer is assigned topatrol can serve as verification that the security officer patrolledtheir assigned route.

In some embodiments, terminal 10 can be operated so that the first frameof image data includes a representation of an operator and the secondframe of image data includes a representation of a generic scene.Further, system 800 can be operative so that the first frame informationincludes image data of the first frame and the second frame informationincludes image data of the second frame. The associating can includeassociating image data of the first frame with image data of the secondframe. In one example, the first and second frames can be associatedwithout modification of image data of either frame. In another examplefor associating image data of the first frame with image data of thesecond frame a frame of image data can be provided including combinedimage data of the first frame and the second frame, e.g., image data ofthe first frame representing an operator presented in a reservedcoordinate space of the second frame so that the representation of thegeneric scene includes a representation of the operator. The associatingcan also or alternatively include simultaneous display of image data ofthe first frame and the second frame. In such embodiment, system 800 canbe operative to provide a record of location of an operator. In onevariation of the described embodiment, the operator is a specificoperator type and the scene provides a record of the location of theoperator. For example the operator can be a security officer. Where theoperator is security officer in the described embodiment, system 800 canbe operative to provide a record of a location of a security officer.

In some embodiments, terminal 10 can be operated so that the first frameof image data includes a representation of an operator where theoperator is health care provider and the second frame of image dataincludes a representation of patient. Further, system 800 can beoperative so that the first frame information includes image data of thefirst frame and the second frame information includes image data of thesecond frame. The associating can include associating image data of thefirst frame with image data of the second frame. In one example, thefirst and second frames can be associated without modification of imagedata of either frame. In another example, for associating image data ofthe first frame with image data of the second frame a frame of imagedata can be provided including combined image data of the first frameand the second frame, e.g., image data of the first frame representingan operator presented in a reserved coordinate space of the second frameso that the representation of a scene including a representation of apatient includes a representation of the health care provider. Forexample, a first frame 1002 including a representation of a health careprovider and a second frame 1004 having a representation of a patientcan be as depicted in FIG. 9. A processed frame 1006 associating imagedata of the first frame and the second frame can be provided as depictedin FIG. 9. Processed frame 1006 can be provided by including in reservedpixel position coordinate space 1008 indicated by border 1008, an imagedata representation of an object represented in the first frame, e.g.,the health care provider represented in the first frame 1002. Processedframe 1006 can be formatted in an image file format, e.g., TIF, PDF,BMP. In the formatted image file in which frame 1006 is formatted, aportion of the image data fields of the image file can include imagedata of the first frame representing an object represented in the firstframe, and a portion of the image file can include image datarepresenting an object represented in the second frame. In the specificexample of FIG. 9, image data of the first frame 1002 shown as beingassociated to second frame image data by being included in processedframe 1006, can be reduced in scale relative to a scale of first frame1002, and accordingly can have a lower resolution than resolution offirst frame 1002. The associating can also or alternatively includesimultaneous display of image data of the first frame and the secondframe, i.e., image data representing the health care provider and imagedata representing a patient. In such embodiment, system 800 can beoperative to provide a record of a patient associated with health careprovider providing care to the patient.

In some embodiments, terminal 10 can be operated so that the first frameof image data includes a representation of an operator where theoperator is health care provider (e.g., doctor, nurse, pharmacist) andthe second frame of image data includes a representation of an articlecomprising medicine. The article can be e.g., a container such as abottle or an intravenous bag. Further, system 800 can be operative sothat the first frame information includes image data of the first frameand the second frame information includes image data of the secondframe. The associating can include associating image data of the firstframe with image data of the second frame. In one example, the first andsecond frames can be associated without modification of image data ofeither frame. In another example, for associating image data of thefirst frame with image data of the second frame a frame of image datacan be provided including combined image data of the first frame and thesecond frame, e.g., image data of the second frame representing anarticle comprising medicine presented in a reserved coordinate space ofthe first frame so that the representation of a scene including arepresentation of a health care provider includes a representation of anarticle comprising medicine administered by the health care provider.The associating can also or alternatively include simultaneous displayof image data of the first frame and the second frame, i.e., image datarepresenting the health care provider and image data representing amedicine containing article administered by the health care provider. Insuch embodiment, system 800 can be operative to provide a record of anarticle of medicine associated with health care provider administeringthe medicine.

In some embodiments, terminal 10 can be operated so that the first frameof image data includes a representation of an operator where theoperator is a health care provider (e.g., doctor, nurse, pharmacist) andthe second frame of image data includes a representation of an articlecomprising medicine. The article can be e.g., a container such as abottle or an intravenous bag and the article can further comprise abarcode encoding a decoded message indicating an identifier for themedicine. Further, system 800 can be operative so that the first frameinformation includes image data of the first frame and the second frameinformation includes a decoded message determined by decoding the barcode via processing of the second frame of image data. The associatingcan include associating image data of the first frame with the decodedmessage. For associating a decoded message to a frame of image data, thedecoded message can be included in an open data field location of aformatted file into which the frame of image data is formatted afterinitial capture. For associating a decoded message to a frame of imagedata, the decoded message and the frame of image data can otherwise beprovided in a common file. For associating a decoded message to a frameof image data, a file can be provided that includes a reference to thedecoded message and the frame of image data. The associating can also oralternatively include simultaneous display of image data of the firstframe and the decoded message, i.e., image data representing the healthcare provider and decoded message data including information respectingthe medicine administered by the health care provider. In suchembodiment, system 800 can be operative to provide a record of anarticle of medicine associated with health care provider administeringthe medicine.

In some embodiments, terminal 10 can be operated so that the first frameof image data includes a representation of an operator where theoperator is a delivery personnel and the second frame of image dataincludes a representation of an article being delivered, e.g., a parcel.Further, system 800 can be operative so that the first frame informationincludes image data of the first frame and the second frame informationincludes image data of the second frame. The associating can includeassociating image data of the first frame with image data of the secondframe. In one example, the first and second frames can be associatedwithout modification of image data of either frame. In another example,for associating an image data of the first frame with image data of thesecond frame a frame of image data can be provided including combinedimage data of the first frame and the second frame, e.g., image data ofthe first frame representing a delivery personnel presented in areserved pixel position coordinate space of the second frame so that therepresentation of a scene including a representation of an article beingdelivered includes a representation of a delivery personnel. Theassociating can also or alternatively include simultaneous display ofimage data of the first frame and the second frame, i.e., image datarepresenting the delivery personnel and image data representing anarticle being delivered. In such embodiment, system 800 can be operativeto provide a record of an article being delivered associated withdelivery personnel delivering the article.

In the example of FIG. 9 and in other examples herein, it was set forththat a processed frame, e.g., processed frame 1006 as shown in FIG. 9provided for associating image data of a first frame and a second framecan include image of the first frame (re-scaled in the particularexample of FIG. 9) and image data of the second frame. In the example ofFIG. 9, reserved pixel position coordinates 1008 of a second frame 1004were designated for inclusion of image data of first frame 1002 for theproviding of processed frame 1006.

In some embodiments, pixel position coordinates for inclusion of any ofthe frames into another of the frames can be variably determined. In theexample of FIG. 10, first frame 1102 captured utilizing imaging assembly150 includes a representation of an operator and second frame 1104includes a representation of a generic scene, in the example shown, amountain range. As indicated in FIG. 10, second frame 1104 can be devoidof a representation of an operator. A processed frame 1106 provided forassociating image data of the first frame 1102 and second frame 1104 isdepicted in FIG. 10. Prior to associating image data of the first frame1102, the image data can be cropped and optionally scaled. The depictedcropping includes removal of image data of first frame 1102 that doesnot correspond to the operator. Removed image data can be, e.g., erasedor suppressed (e.g., included in an open field location of an image filefor later recovery). Processing for cropping of image data can includeexecution of a boundary recognition algorithm for searching forboundaries between image data representing the operator and image datanot representing the operator. Various boundary recognition can beutilized, including various search based and/or zero-crossing basedboundary recognition algorithms. In one example, a Canny edge detectionalgorithm can be utilized. In another example, a differential edgedetection algorithm can be utilized. The resulting processed frame 1106depicts an operator in the scene corresponding to a field of view ofsecond imaging assembly 250. Processed frame 1106 can be formatted in animage file format e.g., TIF, PDF, BMP. The processing depicted in FIG.10 addresses the age old problem of “needing someone else to take apicture.” By the processing depicted in FIG. 10, an operator can utilizeterminal 10 to output a picture of himself in a scene corresponding afield of view of second imaging assembly 250 without use of a timedtrigger while holding terminal 10 in such a manner as to optimize afield of view of imaging assembly 250 with a scene of interest. System800 can be operative so that responsively to actuation of a trigger,e.g., trigger 49, terminal 10 can capture a first frame and a secondframe and further responsively to the actuation of the trigger e.g.,trigger 49, first frame information and second frame information can beassociated. Further responsively to an actuation of a trigger, e.g.,trigger 49, system 800 can display associated image data of a firstframe and second frame on a display, e.g., display, e.g., display 52and/or display 52 of server. Such display can comprise display ofprocessed frame 1106.

In some embodiments, terminal 10 can be operated so that the first frameof image data includes a representation of an operator where theoperator is a delivery personnel and the second frame of image dataincludes a representation of an article being delivered. The article canbe e.g., a parcel and can further comprise a barcode encoding a decodedmessage indicating an identifier for the medicine. Further, system 800can be operative so that the first frame information includes image dataof the first frame and the second frame information includes a decodedmessage determined by decoding the bar code via processing of the secondframe of image data. The associating can include associating image dataof the first frame with the decoded message. For associating a decodedmessage to a frame of image data, the decoded message can be included inan open data field of a formatted image file into which the frame ofimage data is formatted after initial capture. For associating a decodedmessage to a frame of image data, the decoded message and the frame ofimage data can otherwise be provided in a common file. For associating adecoded message to a frame of image data, a file can be provided thatincludes a reference to the decoded message and the frame of image data.The associating can also or alternatively include simultaneous displayof image data of the first frame and the decoded message, i.e., imagedata representing the delivery personnel and decoded message dataincluding information respecting the article delivered by the deliverypersonnel. In such embodiment, system 800 can be operative to provide arecord of an article being delivered associated with delivery personneldelivering the article.

In any of the embodiments described, wherein the first frame informationincludes image data representing an operator of terminal 10, the firstframe information can in addition or instead be provided by a biometricidentifier determined by decoding the image data representing theoperator. In some embodiments, server 500 can include a biometricdatabase including feature data for a plurality of candidate operators.Terminal 10 can transmit a first frame of image data to server 500 forprocessing the frame of image data for determining the biometricidentifier.

While still frames are described in the forgoing examples theassociating of frame information set forth herein can be performedutilizing moving frames, i.e., successions of frames. In one example,server 500 and terminal 10 can be equipped with a display 52 and one ormore imaging assembly 150, 250 and each of server 500 and terminal 10can be configured in accordance with suitable video conferencingsoftware to support line bi-directional video streaming between terminal10 and server 500. In such embodiments, system 800 can be configured sothat a succession of frames transmitted from terminal 10 to server 500are processed frames formatted to include a portion of image datacaptured utilizing imaging assembly 150 and a portion of image datautilizing assembly 250. The succession of processed frames can beprocessed in accordance with a format, e.g., as depicted by frame 1006having reserved pixel position coordinates 1008 for including image datacaptured utilizing a certain one imaging assembly of a set of imagingassemblies 150, 250, and remaining pixel position coordinates forinclusion of image data captured utilizing a remaining imaging assembly150, 250, or as depicted in processed frame 1106 (FIG. 10) withcoordinate pixel positions for inclusion of image data captures using acertain one of the imaging assemblies 150, 250 being variablydetermined, and the remaining pixel coordinates including image datacaptured utilizing the remaining imaging assembly 150, 250. In suchmanner, streaming video comprising frames representing an operator in acurrent environment of the operator can be transmitted.

A small sample of systems methods and apparatus that are describedherein is as follows:

A1. A system for collecting data comprising:

a mobile terminal for capturing a plurality of frames of image data, themobile terminal having a first imaging assembly, a second imagingassembly, a display, and a hand held housing on which the display isdisposed and which houses one or more component of the first imagingassembly and one or more component of the second imaging assembly,wherein the first imaging assembly comprises a first image sensor arrayand a first imaging lens focusing an image onto the first image sensorarray of the first imaging assembly, the first image sensor array havinga plurality of pixels arranged in a plurality of rows and columns ofpixels, the first imaging assembly for use in capturing a first frame ofimage data representing a first object,

wherein the second imaging assembly comprises a second image sensorarray and a second imaging lens focusing an image onto the second imagesensor array of the second imaging assembly, the second image sensorarray having a plurality of pixels arranged in a plurality of rows andcolumns of pixels, the second imaging assembly for use in capturing asecond frame of image data representing a second object; and

wherein the system is operative for associating first frame informationand second frame information, the first frame information including oneor more of image data of the first frame of image data and informationderived utilizing image data of the first frame of image data, thesecond frame information including one or more of image data of thesecond frame of image data and information derived utilizing image dataof the second frame of image data.

A2. The system of A1, wherein the display extends in a display plane,the first imaging assembly includes a first imaging axis extendingupwardly from the display plane and the second imaging assembly includesa second imaging axis extending downwardly from the display plane.A3. The system of A1, wherein the display extends in a display plane,the first imaging axis extends upwardly from the display plane, and thesecond imaging axis extends forwardly from the mobile terminal.A4. The system of A1, further wherein the first imaging assemblyincludes a first imaging axis and the second imaging assembly includes asecond imaging axis, wherein the first imaging axis and second imagingaxis are parallel and spaced apart from each other.A5. The system of A1, further wherein the first imaging assemblyincludes a first imaging axis and the second imaging assembly includes asecond imaging axis, wherein the first imaging axis and the secondimaging axis extend in directions non-parallel relative to one another.A6. The system of A1, wherein the first frame and the second frame arecontemporaneously captured.A7. The system of A1, wherein the mobile terminal includes a trigger,and wherein the system is operative so that responsively to an actuationof the trigger the mobile terminal captures the first frame of imagedata and the second frame of image data.A8. The system of A1, wherein the mobile terminal includes a trigger,and wherein the system is operative so that responsively to an actuationof the trigger the mobile terminal captures the first frame of imagedata and the second frame of image data.A9. The system of A1, wherein the associating comprises providing a filethat includes the first frame information and the second frameinformation.A10. The system of A1, wherein the associating comprises providing afile that includes a reference to the first frame information and areference to the second frame information.A11. The system of A1, wherein the associating comprises providing afile that includes the first frame information and a reference to thesecond frame information.A12. The system A1, further wherein one or more of the first imagesensor assembly and the second image sensor assembly is an infraredimager.A13. The system A1, wherein the associating comprises providing anExtensible Markup Language file that includes a reference to one or moreof the first frame information and the second frame information.A14. The system of claim A1, wherein the associating includes providinga processed frame, the processed frame having image data of the firstframe and image data of the second frame.A15. The system of claim A1, wherein the associating includes providinga processed frame, the processed frame having image data of the firstframe and image data of the second frame, wherein the image data of thefirst frame, included in the processed frame is cropped utilizing aborder recognition algorithm for removal of image data of the firstframe, and wherein the processed frame is formatted in an image fileformat including first image data fields having image data of the firstframe and second image data fields having image data of the secondframe.A16. The system of claim A1, wherein the associating includes providinga processed frame, the processed frame having image data of the firstframe and image data of the second frame, wherein the processed frame isincluded in a succession of processed frames transmitted by the mobileterminal, the succession of processed frames having image data of thefirst frame and image data of the second frame.B1. A method for use in collecting data, comprising:

providing a mobile terminal for capturing a plurality of frames of imagedata, the mobile terminal having a first imaging assembly, a secondimaging assembly, a display, and a hand held housing on which thedisplay is disposed and which houses a component of the first imagingassembly and the second imaging assembly, wherein the first imagingassembly comprises a first image sensor array and a first imaging lensfocusing an image onto the first image sensor array of the first imagingassembly, the first image sensor array having a plurality of pixelsarranged in a plurality of rows and columns of pixels, wherein thesecond imaging assembly comprises a second image sensor array and asecond imaging lens focusing an image onto the second image sensor arrayof the second imaging assembly, the second image sensor array having aplurality of pixels arranged in a plurality of rows and columns ofpixels;

capturing a first frame of image data using the first imaging assembly,the first frame of image data including a representation of a firstobject;

capturing a second frame of image data representing a second image usingthe second imaging assembly, the second frame of image data including arepresentation of a second object; and

associating first frame information and second frame information, thefirst frame information including one or more of image data of the firstframe of image data and information derived utilizing image data of thefirst frame of image data, the second frame information including one ormore of image data of the second frame of image data and informationderived utilizing image data of the second frame of image data.

B2. The method of B1, wherein the capturing the first frame of imagedata includes capturing the first frame of image data so that the firstframe represents of a first object and wherein the capturing the secondframe of image data includes capturing the second frame of image data sothat the second frame represents a second object, and the first objectand the second object are simultaneously present in a targetenvironment.B3. The method of B1, wherein the capturing of the first frame of imagedata and the capturing of the second frame of image data are provided sothat the first frame represents a health care provider and the secondframe represents a patient.B4. The method of B1, wherein the capturing of the second frame of imagedata is provided so that the second frame of image data includes arepresentation of a barcode, and the method further includes the step ofdecoding the barcode representation to determine a decoded message, andfurther wherein the first frame information includes the decodedmessage.B5. The method of B1, wherein the capturing of the first frame of imagedata and the capturing of the second frame of image data are provided sothat the first frame of image data includes a representation of anobject to be delivered to a location, and the second frame of image datarepresents the location.B6. The method of B1, wherein the capturing of the first frame of imagedata and the capturing of the second frame of image data are provided sothat the first frame of image data represents a security officer and thesecond frame of image data includes a representation of a barcode thatidentifies a location of the security officer.B7. The method of B1, wherein the capturing of the first frame of imagedata and the capturing of the second frame of image data are provided sothat the first frame of image data includes a representation of anoperator, and the second frame of image data represents a scene to whichthe operator is proximate.B8. The method of B1, wherein the first frame information comprises abiometric identifier determined by processing the first frame of imagedata.B9. The method of B1, wherein the associating comprises simultaneouslydisplaying the first frame information and the second frame information.B10. The method of B1, wherein the method is performed so that arepresentation of the second object is not included in the first frameof image data.B11. The method of B1, wherein the method includes providing the mobileterminal so that the capturing the first frame and the capturing thesecond frame and the associating are responsive to a trigger signalactivation by an operator, and wherein the method further includes,responsively to an activation of a trigger signal by an operator,capturing the first frame of image data and the second frame of imagedata so that the first frame of image data includes a representation ofthe operator, and the second frame of image data includes arepresentation a scene proximate the operator without including arepresentation of the operator and further responsively to theactivation of the trigger signal, associating the first frameinformation and the second frame information by providing a processedframe including image data of the first frame and image data of thesecond frame, the image data of the first frame being cropped image datathat is cropped for removal of image data not representing the operator.C1. A system for collecting data comprising:

a mobile terminal for capturing a plurality of frames of image data, themobile terminal having a first imaging assembly, a second imagingassembly, a display, and a hand held housing on which the display isdisposed and which houses a component of the first imaging assembly andthe second imaging assembly, wherein the first imaging assemblycomprises a first image sensor array and a first imaging lens focusingan image onto the first image sensor array of the first imagingassembly, the first image sensor array having a plurality of pixelsarranged in a plurality of rows and columns of pixels, wherein thesecond imaging assembly comprises a second image sensor array and asecond imaging lens focusing an image onto the second image sensor arrayof the second imaging assembly, the second image sensor array having aplurality of pixels arranged in a plurality of rows and columns ofpixels;

wherein the system is operative in a first user selectable mode ofoperation and a second user selectable mode of operation;

wherein the system is operative so that with the first user selectablemode of operation active, the mobile terminal is operative so thatresponsively to an activation of a trigger signal by the operator, aframe of image data is captured utilizing the first imaging assemblywithout a frame of image data being captured utilizing the secondimaging assembly;

wherein the system is operative so that with the second user selectablemode of operation active, the mobile terminal is operative so thatresponsively to an activation of a trigger signal by the operator, afirst frame of image data is captured utilizing the first imagingassembly and a second frame of image data is captured utilizing thesecond imaging assembly;

wherein the system is operative for associating first frame informationand second frame information, the first frame information including oneor more of image data of the first frame of image data and informationderived utilizing the image data of the first frame of image data, thesecond frame information including one or more of image data of thesecond frame of image data and information derived utilizing the imagedata of the second frame of image data.

C2. The system of C1, wherein the system is operative so that furtherresponsively to the trigger signal being activated with the second modeof operation active, the associating is performed.

While the present invention has been described with reference to anumber of specific embodiments, it will be understood that the truespirit and scope of the invention should be determined only with respectto claims that can be supported by the present specification. Further,while in numerous cases herein wherein systems and apparatuses andmethods are described as having a certain number of elements it will beunderstood that such systems, apparatuses and methods can be practicedwith fewer than or greater than the mentioned certain number ofelements. Also, while a number of particular embodiments have beendescribed, it will be understood that features and aspects that havebeen described with reference to each particular embodiment can be usedwith each remaining particularly described embodiment.

1. A system for collecting data comprising: a mobile terminal forcapturing a plurality of frames of image data, the mobile terminalhaving a first imaging assembly, a second imaging assembly, a display,and a hand held housing on which the display is disposed and whichhouses one or more component of the first imaging assembly and one ormore component of the second imaging assembly, wherein the first imagingassembly comprises a first image sensor array and a first imaging lensfocusing an image onto the first image sensor array of the first imagingassembly, the first image sensor array having a plurality of pixelsarranged in a plurality of rows and columns of pixels, the first imagingassembly for use in capturing a first frame of image data representing afirst object, wherein the second imaging assembly comprises a secondimage sensor array and a second imaging lens focusing an image onto thesecond image sensor array of the second imaging assembly, the secondimage sensor array having a plurality of pixels arranged in a pluralityof rows and columns of pixels, the second imaging assembly for use incapturing a second frame of image data representing a second object; andwherein the system is operative for associating first frame informationand second frame information, the first frame information including oneor more of image data of the first frame of image data and informationderived utilizing image data of the first frame of image data, thesecond frame information including one or more of image data of thesecond frame of image data and information derived utilizing image dataof the second frame of image data.
 2. The system of claim 1, wherein thedisplay extends in a display plane, the first imaging assembly includesa first imaging axis extending upwardly from the display plane and thesecond imaging assembly includes a second imaging axis extendingdownwardly from the display plane.
 3. The system of claim 1, wherein thefirst imaging assembly includes a first imaging axis and the secondimaging assembly includes a second imaging axis, wherein the displayextends in a display plane, the first imaging axis extends upwardly fromthe display plane, and the second imaging axis extends forwardly fromthe mobile terminal.
 4. The system of claim 1, wherein the first imagingassembly includes a first imaging axis and the second imaging assemblyincludes a second imaging axis, wherein the first imaging axis andsecond imaging axis are parallel and spaced apart from each other. 5.The system of claim 1, wherein the first imaging assembly includes afirst imaging axis and the second imaging assembly includes a secondimaging axis, wherein the first imaging axis and the second imaging axisextend in directions non-parallel relative to one another.
 6. The systemof claim 1, wherein the first frame and the second frame arecontemporaneously captured.
 7. The system of claim 1, wherein the mobileterminal includes a trigger, and wherein the system is operative so thatresponsively to an actuation of the trigger the mobile terminal capturesthe first frame of image data and the second frame of image data. 8.(canceled)
 9. The system of claim 1, wherein the associating comprisesproviding a file that includes the first frame information and thesecond frame information.
 10. The system of claim 1, wherein theassociating comprises providing a file that includes a reference to thefirst frame information and a reference to the second frame information.11. The system of claim 1, wherein the associating comprises providing afile that includes the first frame information and a reference to thesecond frame information.
 12. (canceled)
 13. (canceled)
 14. The systemof claim 1, wherein the associating includes providing a processedframe, the processed frame having image data of the first frame andimage data of the second frame.
 15. The system of claim 1, wherein theassociating includes providing a processed frame, the processed framehaving image data of the first frame and image data of the second frame,wherein the image data of the first frame, included in the processedframe is cropped utilizing a border recognition algorithm for removal ofimage data of the first frame, and wherein the processed frame isformatted in an image file format including first image data fieldshaving image data of the first frame and second image data fields havingimage data of the second frame.
 16. The system of claim 1, wherein theassociating includes providing a processed frame, the processed framehaving image data of the first frame and image data of the second frame,wherein the processed frame is included in a succession of processedframes transmitted by the mobile terminal, the succession of processedframes having image data of the first frame and image data of the secondframe.
 17. A method for use in collecting data, comprising: providing amobile terminal for capturing a plurality of frames of image data, themobile terminal having a first imaging assembly, a second imagingassembly, a display, and a hand held housing on which the display isdisposed and which houses a component of the first imaging assembly andthe second imaging assembly, wherein the first imaging assemblycomprises a first image sensor array and a first imaging lens focusingan image onto the first image sensor array of the first imagingassembly, the first image sensor array having a plurality of pixelsarranged in a plurality of rows and columns of pixels, wherein thesecond imaging assembly comprises a second image sensor array and asecond imaging lens focusing an image onto the second image sensor arrayof the second imaging assembly, the second image sensor array having aplurality of pixels arranged in a plurality of rows and columns ofpixels; capturing a first frame of image data using the first imagingassembly, the first frame of image data including a representation of afirst object; capturing a second frame of image data representing asecond image using the second imaging assembly, the second frame ofimage data including a representation of a second object; andassociating first frame information and second frame information, thefirst frame information including one or more of image data of the firstframe of image data and information derived utilizing image data of thefirst frame of image data, the second frame information including one ormore of image data of the second frame of image data and informationderived utilizing image data of the second frame of image data.
 18. Themethod of claim 17, wherein the capturing the first frame of image dataincludes capturing the first frame of image data so that the first framerepresents of a first object and wherein the capturing the second frameof image data includes capturing the second frame of image data so thatthe second frame represents a second object, and the first object andthe second object are simultaneously present in a target environment.19. The method of claim 17, wherein the capturing of the first frame ofimage data and the capturing of the second frame of image data areprovided so that the first frame represents a health care provider andthe second frame represents a patient.
 20. The method of claim 17,wherein the capturing of the second frame of image data is provided sothat the second frame of image data includes a representation of abarcode, and the method further includes the step of decoding thebarcode representation to determine a decoded message, and furtherwherein the first second frame information includes the decoded message.21. The method of claim 17, wherein the capturing of the first frame ofimage data and the capturing of the second frame of image data areprovided so that the first frame of image data includes a representationof an object to be delivered to a location, and the second frame ofimage data represents the location.
 22. The method of claim 17, whereinthe capturing of the first frame of image data and the capturing of thesecond frame of image data are provided so that the first frame of imagedata represents a security officer and the second frame of image dataincludes a representation of a barcode that identifies a location of thesecurity officer.
 23. The method of claim 17, wherein the capturing ofthe first frame of image data and the capturing of the second frame ofimage data are provided so that the first frame of image data includes arepresentation of an operator, and the second frame of image datarepresents a scene to which the operator is proximate.
 24. The method ofclaim 17, wherein the first frame information comprises a biometricidentifier determined by processing the first frame of image data. 25.The method of claim 17, wherein the associating comprises simultaneouslydisplaying the first frame information and the second frame information.26. The method of claim 17, wherein the method is performed so that arepresentation of the second object is not included in the first frameof image data.
 27. The method of claim 17, wherein the method includesproviding the mobile terminal so that the capturing the first frame ofimage data and the capturing the second frame of image data and theassociating are responsive to a trigger signal activation by anoperator, and wherein the method further includes, responsively to anactivation of a trigger signal by an operator, capturing the first frameof image data and the second frame of image data so that the first frameof image data includes a representation of the operator, and the secondframe of image data includes a representation a scene proximate theoperator without including a representation of the operator and furtherresponsively to the activation of the trigger signal, associating thefirst frame information and the second frame information by providing aprocessed frame including image data of the first frame and image dataof the second frame, the image data of the first frame being croppedimage data that is cropped for removal of image data not representingthe operator.
 28. A system for collecting data comprising: a mobileterminal for capturing a plurality of frames of image data, the mobileterminal having a first imaging assembly, a second imaging assembly, adisplay, and a hand held housing on which the display is disposed andwhich houses a component of the first imaging assembly and the secondimaging assembly, wherein the first imaging assembly comprises a firstimage sensor array and a first imaging lens focusing an image onto thefirst image sensor array of the first imaging assembly, the first imagesensor array having a plurality of pixels arranged in a plurality ofrows and columns of pixels, wherein the second imaging assemblycomprises a second image sensor array and a second imaging lens focusingan image onto the second image sensor array of the second imagingassembly, the second image sensor array having a plurality of pixelsarranged in a plurality of rows and columns of pixels; wherein thesystem is operative in a first user selectable mode of operation and asecond user selectable mode of operation; wherein the system isoperative so that with the first user selectable mode of operationactive, the mobile terminal is operative so that responsively to anactivation of a trigger signal by the operator, a frame of image data iscaptured utilizing the first imaging assembly without a frame of imagedata being captured utilizing the second imaging assembly; wherein thesystem is operative so that with the second user selectable mode ofoperation active, the mobile terminal is operative so that responsivelyto an activation of a trigger signal by the operator, a first frame ofimage data is captured utilizing the first imaging assembly and a secondframe of image data is captured utilizing the second imaging assembly;wherein the system is operative for associating first frame informationand second frame information, the first frame information including oneor more of image data of the first frame of image data and informationderived utilizing the image data of the first frame of image data, thesecond frame information including one or more of image data of thesecond frame of image data and information derived utilizing the imagedata of the second frame of image data.
 29. (canceled)
 30. The system ofclaim 1, wherein the mobile terminal includes a trigger, and wherein thesystem is operative so that responsively to an actuation of the triggerthe mobile terminal captures the first frame of image data and thesecond frame of image data.
 31. The system claim 1, wherein one or moreof the first image sensor assembly and the second image sensor assemblyincludes an image sensor array that is selectively sensitive to light inthe infrared wavelength band.
 32. The system claim 1, wherein theassociating comprises providing an Extensible Markup Language file thatincludes a reference to one or more of the first frame information andthe second frame information.
 33. The system of claim 28, wherein thesystem is operative so that further responsively to the trigger signalbeing activated with the second mode of operation active, theassociating is performed.
 34. The method of claim 17, wherein the methodincludes providing the mobile terminal so that the capturing the firstframe of image data and the capturing the second frame of image data areresponsive to a trigger signal activation by an operator, wherein thecapturing of the second frame of image data is provided so that thesecond frame of image data includes a representation of a barcode, andwherein the method further includes the step of decoding the barcoderepresentation to determine a decoded message, and further wherein thesecond frame information includes the decoded message.
 35. The method ofclaim 34, wherein the associating comprises including the decodedmessage in an open data field location of an image file that includesimage data of the first frame of image data.
 36. The method of claim 34,wherein the associating comprises providing a file that commonlyreferences an image file having image data of the first frame of imagedata and the decoded message.